Dynamical clustering in oscillator ensembles with time-dependent interactions 
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We consider an ensemble of coupled oscillators whose individual states, in addition to the phase, 
are characterized by an internal variable with autonomous evolution. The time scale of this evo- 
lution is different for each oscillator, so that the ensemble is inhomogeneous with respect to the 
internal variable. Interactions between oscillators depend on this variable and thus vary with time. 
We show that as the inhomogeneity of time scales in the internal evolution grows, the system un- 
dergoes a critical transition between ordered and incoherent states. This transition is mediated by a 
regime of dynamical clustering, where the ensemble recurrently splits into groups formed by varying 
subpopulations. 
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Synchronization phenomena in interacting dynamical 
systems have attracted a great deal of attention in the 
last two decades The spontaneous appearance of 
coherent evolution as a result of interactions is ubiq- 
uitous in a vast class of natural and artificial systems, 
and can be successfully reproduced by relatively sim- 
ple models. Most studies of this kind of phenomena 
have focused on patterns of highly correlated evolution, 
such as full and phase synchronization. Though these 
forms of synchronization are essential to certain artificial 
systems — for instance, secure-communication and chaos- 
control devices — they are expected to play a more re- 
stricted role in such objects as biological populations, 
where the complexity of their collective function requires 
a delicate balance between behavioral coherence and di- 
versity 0- A clear-cut example is the human brain, 
where highly coherent functional patterns are only real- 
ized under pathological states — notably, during epileptic 
seizures. Neural tissues, as well as many natural sys- 
tems ranging from intracellular molecular complexes to 
social populations, are normally found in segregated con- 
figurations, where the system splits into groups of ele- 
ments with distinct functions. In these clustered states, 
highly coherent evolution occurs inside each group, while 
the collective dynamics of different groups are much less 
correlated. This is typically a dynamical phenomenon, 
since — as a consequence of the evolution of the inter- 
nal state of each element — clusters may temporarily dis- 
perse to be reconstituted later, and individual elements 
or small groups can migrate between clusters. 

Clustering has been observed in ensembles of cou- 
pled dynamical systems with specific individual dynamics 
or subject to sufficiently complex interaction func- 
tions 1^ 1^ . Disintegration of clusters and migration of 
elements is typically observed under the action of noise 
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0, 0, HI- In this Letter, we show that such kind of dy- 
namical clustering can occur in an ensemble of coupled 
periodic oscillators, in the absence of external fluctua- 
tions, when the interaction between oscillators depends 
on individual internal state variables with autonomous 
evolution. The time scale of this internal evolution dif- 
fers between oscillators. A critical transition between 
ordered and incoherent evolution, mediated by dynami- 
cal clustering, takes place as the inhomogeneity of such 
time scales grows. 

Consider N coupled phase oscillators, each of them 
characterized by a phase variable (t>i{t), obeying by the 
equations 



N 

(pi = N^'^ ^ Jy (i) sin(0j - (/)^) 



(1) 



(j = 1, • ■ • , N). When the interaction weights Jij{t) are 
constant, Jij(t) = J for all i and j, these equations re- 
duce to Kuramoto's model for identical phase oscillators 
jOj, which exhibits full synchronization for any positive 
value of J. Time-independent non-identical interaction 
weights have also been considered, disclosing typical fea- 
tures of disordered systems, such as glassy-like behavior, 
frustration, and algebraic relaxation towards equilibrium 
[Tol im . Here, we analyze the case where the interaction 
weights depend on the internal state of each oscillator, 
which is specified by a variable 9i{t) with autonomous 
evolution. Specifically, we consider that 9i is itself a 
phase variable evolving according to 6i = fli, where the 
frequency fli is chosen at random for each element, from 
a fixed distribution q{Q). The interaction weight is given 
by 



j^j{t) = jcos[ej{t)-e,{t)], 



(2) 



where J > is a constant factor that can be fixed to 
J = 1 by rescaling time. With this choice for J^, the in- 
teraction between the phase and (jfj is attractive when 
cos{6j — 0i) is positive, and repulsive otherwise. The sign 
of Jij changes in a time scale of order — giving 
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rise — at the level of the whole ensemble — to a complex 
time-dependent interaction pattern. This evolving con- 
nection network makes possible the appearance of several 
dynamical regimes, including clustering. 

We start our study of the above model by perform- 
ing extensive numerical realizations in ensembles rang- 
ing in size from N = 10^ to 10^. The internal frequencies 
f2i are drawn at random from a Gaussian distribution, 
g{n) = exp[— (f2 — no)^/2cT^]/\/27rcr2. Since the dynam- 
ics is invariant under a constant shift in these frequencies, 
we fix ilo = 0. It turns out that the collective behavior 
of the ensemble is sensible to the frequency dispersion 
a. For small a interactions evolve slowly, over long time 
scales. Consequently, the phase (pi can adiabatically fol- 
low the evolution of the interaction weights. For long 
times, the system is found in a state where the phases 0^ 
are homogeneously distributed over the interval [0,2n). 
A strong correlation is observed in such state between 
and the internal variable 9i, namely, « ±9i + po, 
where 4>q is a constant. The sign factor of 9i and the 
value of (f)o are the same for all oscillators, and depend 
on the initial condition; moreover, (jjQ can slowly change 
as time elapses. For large a, on the other hand, many 
of the interaction weights exhibit large changes over very 
short times. Each oscillator is thus subject to rapidly 
fluctuating forces, which again results in a state where 
the phases are homogeneously distributed over [0, 27r). 
Now, however, there is no correlation between 0j and 9i. 

To characterize the transition between the regimes of 
small and large frequency dispersion we introduce, for 
each oscillator, the two-dimensional complex vector nii = 
(exp[i((/)i — 9i)], exp[i{(j>i + 9i)]), and define the average 

N 

ni = N-^^nij = (/i+exp(iV'+),/i-exp(iV'-)). (3) 

The time average fi of yJi^+JiK is a suitable order pa- 
rameter for the transition. If the system spends most of 
the time in the state where 0j « ±9i + 0o for all i, we 
have /i ~ 1, while fi ^ N^^^^ in the incoherent state. 
Figure ^ shows numerical results for /i as a function of 
cr for various system sizes. The dependence with N sug- 
gest the presence of a critical phenomenon for a ~ 0.3. 
Within a few assumptions supported by numerical evi- 
dence, this critical behavior can be analytically studied 
in the limit — + oo, as follows. First of all, we note 
that for a and at sufficiently long times, the internal 
variables 9^ are homogeneously distributed over [0, 27r). 
If, in the limit cr — > (but tr ^ 0), the temporal variation 
of 9i is disregarded, (pi = ±9i + (po is a stationary state 
of our system, as direct substitution in Eq. Q shows. 
This conclusion holds for any distribution of frequencies 
highly concentrated around = 0. For larger values of 
cr, we write (pi = ±{9i — Si) + (po, where Si{t) measures 
the deviation of each oscillator with respect to the small- 
dispersion state. This deviation satisfies 

6^ = Qi- ^sinSi, (4) 



where we have written the order parameter fj, in terms of 
the distribution of the deviations Si over the ensemble, 
p{S), as 

M = / P{^) COS S dS. (5) 

Here, we have assumed that p(5) is an even function; as 
shown below, this amounts to postulate that g{Q) is itself 
even. 
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FIG. 1: The order parameter fi as a, function of the frequency 
dispersion a for ensembles of various sizes, N = 10^ (x), 10^ 
(o), 10* (•), 10^ (□), and 10® (o). The curve stands for r 
as calculated from Eq. @. Inset: Schematic representation 
of the motion of the four clusters observed for intermediate 
frequency dispersions, in (^-space (see text). 

Equation has been extensively discussed in connec- 
tion with phase-oscillator ensembles For Ifli] < /i/2 
it has a stable fixed point at one of the solutions of 
s'mSi = 2Vli/iJ.. For \Vli\ > /i/2, on the other hand, 
there are no fixed points and \Si\ grows indefinitely with 
time. The ensemble can therefore be thought of as 
consisting of two subpopulations. Those oscillators for 
which \ < /i/2 attain, at asymptotically large times, 
a stationary deviation Si, which depends on the value 
of rii. For the oscillators with > /i/2, in contrast, 
the phase (f)i does not reach a stationary value with re- 
spect to 9i. We refer to these two subpopulations as 
subensembles I and II, respectively. The distribution p(S) 
can be split into contributions from each subensemble, 
p — pi + pii. The first contribution is found from the 
distribution of frequencies, taking into account the iden- 
tity pi{S)dd — g(Q)dn. As for pu, it can be shown that 
its contribution to the integral of Eq. jSJ vanishes. This 
equation becomes, then, 

n= / gin)y/i-m^/ii^ dn, (6) 

making it possible to find /i self-consistently for any 
(even) distribution of frequencies. Under quite general 
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conditions on g{^), this equation describes a second- 
order transition between disordered (/i = 0) and ordered 
{fi 7^ 0) states. For fi ^ 0, two states are possible, ei- 
ther with ^ or with /i„ ^ 0, which demonstrates 
the occurrence of symmetry breaking at the transition. 
The curve in Fig.^shows the solution to Eq. © for the 
Gaussian distribution of frequencies considered in our nu- 
merical realizations. It vanishes sls iJ, ^ W ~ "'cl^^^ at 
CTc = y/7r/32 w 0.313. 

Note that Eq. Q can be written, in terms of the av- 
erage quantity introduced in Eq. (O, as 

0, = ^ sin(7/.+ +e^-cj),) + ^ sin(V- -e^-^^). (7) 

This form of the equation of motion for 0^ emphasizes 
the mean- field nature of interactions. The fact that, as 
iV — > oo, /i vanishes for a > ac, implies that the two 
terms in the right-hand side of Eq. {Tj) vanish as well. 
For finite system sizes, they are of order N~-^/^. Hence, 
beyond the critical dispersion ac, the evolution of phases 
can be thought of as driven by fluctuating forces of or- 
der N~^/'^. In the thermodynamical limit, for a > ac, 
the dynamics is frozen. Below the transition, evolution 
becomes progressively slower as the critical point is ap- 
proached. 

Numerical simulations show that for intermediate val- 
ues of (T, as the predominance of the ordered small- 
dispersion state decreases and the critical transition is ap- 
proached, a complex regime of clustering develops. Those 
oscillators in subensemble II with frequencies just above 
their lowest value, > m/S, become divided into four 
clusters in 0-space. Though the structure of each cluster 
is not sharply localized, it is still possible to define its 
phase by averaging over the oscillators in that clus- 
ter. Two of the clusters are formed by oscillators with 
f2i > 0, and exhibit anti-phase synchronization, so that 
their phases differ by tt at all times. They move mono- 
tonically around (^-space. The other two move in the 
opposite direction. They are formed by oscillators with 
ili < 0, and also show anti-phase synchronization (see 
inset of Fig. Due to the opposite motion of the two 
pairs of clusters, they recurrently cross each other. At 
these crossings, their populations are temporarily super- 
imposed in phase and, at the same time, their motion 
decelerates and the clusters become more compact. As 
a result, two well-localized and relatively long-lived big 
clusters, their phases differing by tt, are recurrently built 
up out of the ensemble (see Fig.|3;). 

The occurrence of two-cluster states is quantitatively 
disclosed by the complex quantity 

N 

z = N-^^exp{2i<j>j). (8) 

If the whole ensemble splits into two anti-phase well- 
localized clusters, we have \z(t) \ « 1, while for incoherent 
or higher-order clustered states we have \z{t)\ ~ N~-^/^. 



Figure shows the evolution of \z{t)\ in the cluster- 
ing regime, displaying its irregular oscillations between 
relatively small and large values. For the same realiza- 
tion. Fig. |2b displays the phase difference Acj) between 
two oscillators in subensemble II, both with positive val- 
ues of Hi, as a function of time. When \z{t)\ is large, 
cosA(/) Ri 1 identifies a two-cluster state where the two 
oscillators belong to the same cluster, while cos A(/> « — 1 
corresponds to the situation where the oscillators are in 
different clusters. The intermittent transitions of cos Acj) 
between large positive and negative values reveal the dy- 
namical nature of clustering, where any two oscillators 
may alternatively belong to the same or to different clus- 
ters. 
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FIG. 2: (a) The quantity \z{t)\ as a function of time in a sys- 
tem of 10* oscillators with Gaussian frequency distribution of 
dispersion a = 0.31. (b) Phase difference of two oscillators 
with similar frequencies, in the same realization as in the up- 
per plot, (c) Snapshot of the phase distribution at one of the 
maxima of 1^(^)1, in the same realization. 

The time average C of the quantity \z{t) \ plays the role 
of an order parameter detecting the two-cluster state. 
Figure 13 displays the dependence of C with the frequency 
dispersion a, for ensembles of several sizes. A peak near 
CTc becomes clearly defined as N grows. While for cr > Cc 
the value of C apparently vanishes for large system sizes, 
a well-defined profile persists below the critical point. It 
grows from zero starting at cr « 0.2 and attains its max- 
imum, ( « 0.25, at cr < ac- 

The formation of the four clusters whose recurrent su- 
perimposition gives rise to the two-cluster states detected 
by C can be qualitatively understood in terms of previ- 
ous results for coupled oscillators with disordered interac- 
tions. Given an oscillator whose internal variable evolves 
with frequency f2i, the most persistent interactions af- 
fecting the dynamics of its phase are due to oscillators 
with similar frequencies, flj ~ fli. In this case, in fact, 
the interaction weights Jij are almost constant over very 
long time scales. These weights, however, are still differ- 
ent from each other, and can take positive and negative 
values. If the effect of frustration is moderate, the os- 
cillators become entrained into two anti-phase groups of 
similar sizes [Tol |. The occurrence of this phenomenon 
requires that the oscillator phases are not pinned to the 
internal variables, and that a consistent population with 
similar frequencies Qi actually exists to trigger conden- 
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sation. Such conditions are met by those oscillators of 
subensemble II with either positive or negative frequen- 
cies, close to the limit — ii/2^ where the popula- 
tion density is larger. Note that increasing the frequency 
dispersion tr contributes in two cooperating ways to the 
growth of subensemble II, and thus to the formation of 
clusters: it implies, at the same time, a larger population 
for high frequencies and — as ^ decreases — a population 
depletion in subensemble I. As discussed above, however, 
clustering is delayed by increasingly long transients as a 
approaches the critical point. In the limit N oo^ the 
evolution freezes just beyond the critical dispersion, and 
cluster formation is thus suppressed. 
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FIG. 3: The order parameter as a function of the frequency 
dispersion a, obtained from numerical simulations of ensem- 
bles of various sizes, A/' = 10^ (x), 10^ (o), 10'' (•), 10^ (□), 
and 10^ (o). The vertical dashed line indicates the critical 
dispersion CTc = y7r/32. 

It is possible to give an approximate mathematical de- 
scription of the motion of the four clusters, assuming 
that one of them is centered around a phase (j)* {t) and is 
formed by oscillators whose internal frequencies are, on 
the average, fi*. The phases and frequencies of the other 
three clusters can be derived from symmetry considera- 
tions. If the total fraction of the population involved in 
clusters is n*, the approximate equation of motion for 



2(1)* 



'fi sin(0* T ^*t) - n* cos(217*t) sin(20*). (9) 



The two terms in the right-hand side correspond, re- 
spectively, to the contributions of subensembles I and 
II. They have competing dynamical effects, and their 
relative importance changes as a and n* grow while ji 
decreases. The first term favors the development of cor- 
relations between (p* and the internal variable fl*t. If, 
on the other hand, the second term prevails, the phase 
difference between clusters of opposite internal frequen- 
cies, 2(j>*, spends most of the time close to its two fixed 
points, 2(j)* — or tt, with rapid transitions between them 
when the sign of cos(20*i) changes. These fixed points 
correspond, precisely, to the mutual crossing of clusters 
of opposite frequencies that give origin to the recurrent 
two-cluster state. 

Preliminary numerical results show that dynamical 
clustering occurs also in ensembles of particles moving 
in space and coupled through finite-range interactions, 
with autonomous internal variables as those considered 
above. In more complex models of interacting dynamical 
elements with evolving internal states, dynamical cluster- 
ing may be enhanced if the internal variables themselves 
undergo segregation into coherent groups. This can be 
achieved, for example, if interactions between internal 
states are allowed. Numerical realizations suggest that 
this is the case when the variables 9i of the model studied 
above are coupled through higher-harmonics interaction 
functions 0, which give rise to dynamical clustering if 
noise is added to the internal evolution. The same effect 
has recently been illustrated for ensembles of interacting 
particles moving in space, where the internal dynamics of 
each element is represented by a chaotic map whose evo- 
lution is coupled to those of neighboring particles ^3 • In 
real systems — specifically, in biological populations — the 
interaction between internal variables is expected to play 
an important role when such mechanisms as imitation 
and social influence are in action. 
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